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Design of sample surveys and experiments is a core topic in statistics
and a major transition in concepts. Data analysis emphasizes under-
standing the specific data at hand. Now the data are regarded as repre-
senting a larger population. It is the population we seek to understand.
Students do not find this added abstraction easy to assimilate. They
persist, for example, in trying to explain variable results when an ex-
perimental task is carried out by several students in terms of individual
characteristics of Sarah, Matthew, and Ruth. The "sampling" point of
view regards these students as representative of a large population of
students. We are no longer interested in individual features that may
explain the performance of Sarah, Matthew, and Ruth.

The transition from data analysis to inference follows a parallel path
in mathematical abstraction. The sample mean x is no longer just a
single number, a measure of location for these data. It is a realization
of a random variable to be considered against the background of the
distribution of the random variable; it must be viewed against what
would happen if we repeated the data production process many times.
The difficulty of these new ideas cannot be disguised.

Fortunately, the intimate connection of designed data production
with the ideas of probability and the logic of inference need not ap-
pear at once. There is much valuable insight into data to be gained
first. It is very important, for example, to recognize unrepresentative
data. Anecdotal evidence based on a few individual cases known to
us influences our thinking in ways that cannot withstand examination
and therefore must be examined. Individual cases catch our attention
because they are unusual in some way or because they occur in our im-
mediate environment. Examples and discussion will show that there is
no reason to expect these cases to be in any way typical.

Improper sampling methods, especially voluntary response samples
in which the respondents choose themselves, are also fair game. Here
is an example:

Advice columnist Ann Landers conducts a voluntary response
survey every few years by asking her readers to respond to a
provocative question. The results are always good for news ar-
ticles and radio interviews that publicize her column. Her first
survey is the most instructive because a comparison is available.
In 1975 Ann Landers asked "If you had it to do over again,
would you have children?" Almost 70% of the nearly 10,000
respondents said "no." Many accompanied their responses by
heart-rending tales of the cruelties inflicted on them by their